Spoken Dialogue: Extending Embedded Virtual Simulation with a Very Human Dimension

Embedded virtual simulation, employed in many NATO training communities, is a key to addressing urgent training needs in areas that stretch the capabilities offered by conventional simulation techniques. Of particular relevance to NATO are training needs such communication and tactical team coordination. This paper will summarize some needs in training and mission planning that remain unmet, discuss the reasons why and propose some specific approaches that extend the reach of simulation in directions that directly address these gaps. We focus on communication and tactical team training. We will show specific examples of our approaches that are solving tangible training and rehearsal problems among NATO constituencies and discuss how this approach can be broadly applied across a spectrum of training settings. 1.0 INTRODUCTION/RELEVANCE TO THE WORKSHOP Replicating unfamiliar areas of operation in a synthetic environment can expose NATO forces to a spectrum of tactical possibilities they may encounter in-theater. The use of simulation in training, mission planning and rehearsal is a long-accepted practice, but when forces deploy with little notice, or to locales with insufficient technology infrastructure, the benefits of virtual simulation remain beyond reach. Embedded virtual simulation can help mitigate these challenges faced by NATO forces when rapidly deploying to new locations, by providing training, mission planning and rehearsal capabilities along with the digital systems employed operationally. Some skills have been overlooked in embedded simulation, namely, communication and team coordination. Such skills are gaining increasing importance, as forces are more multinational and as missions are increasingly conducted against an asymmetric adversary and complicated by proximity to and political reliance on non-combatants. This training gap is due largely to the complex and highly verbal interactions needed to incorporate spoken dialogue into synthetic environments. Nonetheless, this very human dimension remains a critical part of realistic training, planning and rehearsal. In this paper we report on work to embed speech-interactive synthetic agents into purpose-built training, mission planning and rehearsal systems.